Unsupervised clustering of ambulatory audio and video
نویسندگان
چکیده
A truly personal and reactive computer system should have access to the same information as its user, including the ambient sights and sounds. To this end, we have developed a system for extracting events and scenes from natural audio/visual input. We nd our system can (without any prior labeling of data) cluster the audio/visual data into events, such as passing through doors and crossing the street. Also, we hierarchically cluster these events into scenes and get clusters that correlate with visiting the supermarket, or walking down a busy street.
منابع مشابه
A statistical approach to classify Skype traffic
Abstract- Skype is one of the most powerful and high-quality chat tools that allows its users to use of many services such as: transferring audio, sending messages, video conferencing and audio for free. Skype traffic has a lot of Internet traffic. Hence, Internet service providers need to identify traffic to do the quality of service and network management. On the other hand, Skype developers ...
متن کاملHigh-Dimensional Unsupervised Active Learning Method
In this work, a hierarchical ensemble of projected clustering algorithm for high-dimensional data is proposed. The basic concept of the algorithm is based on the active learning method (ALM) which is a fuzzy learning scheme, inspired by some behavioral features of human brain functionality. High-dimensional unsupervised active learning method (HUALM) is a clustering algorithm which blurs the da...
متن کاملUnsupervised Video Indexing based on Audiovisual Characterization of Persons. (Indexation vidéo non-supervisée basée sur la caractérisation des personnes)
This thesis consists to propose a method for an unsupervised characterization of personswithin audiovisual documents, by exploring the data related for their physical appearance andtheir voice. From a general manner, the automatic recognition methods, either in video or audio,need a huge amount of a priori knowledge about their content. In this work, the goal is to study213 the ...
متن کاملUnsupervised Decoding of Long-Term, Naturalistic Human Neural Recordings with Automated Video and Audio Annotations
Fully automated decoding of human activities and intentions from direct neural recordings is a tantalizing challenge in brain-computer interfacing. Implementing Brain Computer Interfaces (BCIs) outside carefully controlled experiments in laboratory settings requires adaptive and scalable strategies with minimal supervision. Here we describe an unsupervised approach to decoding neural states fro...
متن کاملImproving Cluster Selection and Event Modeling in Unsupervised Mining for Automatic Audiovisual Video Structuring
Can we discover audio-visually consistent events from videos in a totally unsupervised manner? And, how to mine videos with different genres? In this paper we present our new results in automatically discovering audio-visual events. A new measure is proposed to select audio-visually consistent elements from the two dendrograms respectively representing hierarchical clustering results for the au...
متن کامل